TV mode change in accordance with number of viewers present

ABSTRACT

This application is directed to changing a TV operating mode based on a potential relationship among viewers of a connected TV. In some implementations, a method includes: determining viewer identities and identifying the potential relationship among the viewers or a subset of the viewers; in accordance with a determination that the potential relationship allows the viewers to share private information, placing or maintaining the connected TV in or into a first operating mode that is unrelated to media content being displayed and allows personal information to be displayed on the connected TV; and in accordance with a determination that the potential relationship does not allow the viewers to share private information, placing or maintaining the connected TV in or into a second operating mode that is unrelated to the media content and does not allow personal information to be displayed on the connected TV.

PRIORITY CLAIM AND RELATED APPLICATIONS

This application is a continuation of and claims priority to U.S. patentapplication Ser. No. 14/807,792, filed on Jul. 23, 2015, issued as U.S.Pat. No. 9,942,608 on Apr. 10, 2018, entitled “TV Mode Change inAccordance with Number of Viewers Present,” which is a continuation andclaims priority to U.S. patent application Ser. No. 13/831,055, filed onMar. 14, 2013, issued as U.S. Pat. No. 9,100,694 on Aug. 4, 2015,entitled “TV Mode Change in Accordance with Number of Viewers Present.”Each of these two patent applications is hereby incorporated byreference in its entirety.

TECHNICAL FIELD

The disclosed implementations relate generally to changing TV mode inaccordance with number of viewers present.

BACKGROUND

Connected TVs, in addition to displaying conventional TV content, candisplay information from the Internet or home networks and/orinformation from second screen or portable devices, such as smart phonesor tablet computers, which are paired with or locally networked with theTV. This multiplicity of connections enables viewers to access a rangeof media content and information (including personal information) fromtheir TV. For example, while watching a TV program on a connected TV aviewer might also be able to access from the same TV social media postsand incoming email from his or her Internet accounts and text messagesfrom his or her paired smart phone. While this integration is convenientfor viewers, this situation also presents the challenge that it is notalways ideal to provide all available information on the TV at alltimes. For example, while watching TV programs alone, a viewer mightwant to have his or her personal information (e.g., incoming textmessages) displayed on the TV, but this is not likely to be the casewhen he or she is viewing a sports event on the same TV with a group offriends. Therefore, it would be useful to have a convenient way ofcontrolling what sorts of information is presented on a connected TV inaccordance with a user's preferences.

BRIEF DESCRIPTION OF THE DRAWINGS

The implementations disclosed herein are illustrated by way of example,and not by way of limitation, in the figures of the accompanyingdrawings. Like reference numerals refer to corresponding partsthroughout the drawings.

FIG. 1A is a block diagram illustrating a computer system, in accordancewith some implementations.

FIGS. 1B-1D are block diagrams illustrating example configurations of acomputer system for changing device operating mode in accordance withnumber of viewers present.

FIG. 2 is a block diagram illustrating an example supplemental set-topbox, in accordance with some implementations.

FIGS. 2A-2C are block diagrams illustrating example privacy settings indifferent operating modes, in accordance with some implementations.

FIG. 3 is a block diagram illustrating another example supplementalset-top box, in accordance with some implementations.

FIGS. 3A-3C are block diagrams illustrating example control settings indifferent operating modes, in accordance with some implementations.

FIG. 3D is a flow chart illustrating a method for applying and overrdingdefault control or privacy settings, in accordance with someimplementations.

FIG. 4 is a block diagram illustrating a server system, in accordancewith some implementations.

FIG. 5 is a flow chart illustrating a method for changing TV operatingmode in accordance with number of viewers present, in a computer system,in accordance with some implementations.

FIG. 6 is a flow chart illustrating a method for changing TV operatingmode in accordance with number of viewers present, at a supplementalset-top box, in accordance with some implementations.

FIG. 7 is a block diagram illustrating an example functional diagramillustrating operations or modules used in a supplemental STB that areconfigured to change operating modes of a TV based on the number ofviewers present, in accordance with some implementations.

SUMMARY

Systems, methods, devices, and non-transitory computer readable storagemediums for changing TV mode in accordance with number of viewerspresent are hereby disclosed.

In some implementations, a method for changing TV mode in accordancewith number of viewers present includes: at a supplemental set-top box,obtaining a total number of viewers of a connected TV, the connected TVhaving a plurality of operating modes, where the total number is one ormore; in accordance with a determination that the total number ofviewers is within a first predefined range of a plurality of predefinedranges; placing or maintaining the connected TV in or into a firstoperating mode unrelated to media content being displayed on theconnected TV; and in accordance with a determination that the totalnumber of viewers is within a second predefined range of the pluralityof predefined ranges: placing or maintaining the connected TV in or intoa second operating mode unrelated to the media content; wherein thesecond operating mode is different from the first operating mode.

In some implementations, the method further includes: determiningidentity of a first viewer of the connected TV; determining identity ofa second viewer of the connected TV; determining a potentialrelationship between the first and second viewers based on theidentities of the first and second viewers; and placing or maintainingthe connected TV in or into a respective operating mode of the pluralityof operating modes, in accordance with the potential relationship.

In some implementations, a respective operating mode of the plurality ofoperating modes is associated with different privacy settings.

In some implementations, obtaining a total number of viewers of theconnected TV includes one of: (i) collecting facial or voice recognitiondata associated with the viewers; and determining the total number ofviewers of the connected TV based on the facial or voice recognitiondata; (ii) collecting information identifying one or more consumerelectronic devices associated with the viewers; and determining thetotal number of viewers of the connected TV based on the informationidentifying the consumer electronic devices; or (iii) collecting a userinput indicating the total number of viewers of the connected TV.

In some implementations, the method further comprises: obtainingidentities associated with the viewers of the connected TV by: (i)collecting facial or voice recognition data associated with the viewers;and comparing the collected facial or voice recognition data with aviewer identity database; or (ii) collecting information identifying oneor more consumer electronic devices associated with the viewers; andcomparing the collected information with a device database; and placingor maintaining the connected TV in or into a respective operating modeof the plurality of operating modes, in accordance with the identitiesassociated with the viewers.

In some implementations, the plurality of operating modes includes: apersonal mode, a shared mode, and a party mode; and the plurality ofpredefined ranges includes: a predefined range for one viewer, apredefined range for a small group of viewers, and a predefined rangefor a large group of viewers.

In some implementations, the method also includes: placing ormaintaining the connected TV in or into the personal mode when the totalnumber of viewers is 1; placing or maintaining the connected TV in orinto the shared mode when the total number of viewers is 2 to 3; orplacing or maintaining the connected TV in or into the party mode whenthe total number of viewers is 4 or more.

In some implementations, in the personal mode, personal informationreceived from an external source can displayed on the connected TV; inthe shared mode, personal information received from an external sourcemay not be displayed; and in the group mode, personal informationreceived from an external source may not be displayed on the connectedTV, and media content appropriate for a large group of viewers isdisplayed on the connected TV.

In some implementations, the media content appropriate for a large groupof viewers is one of: a photo slideshow, an audio and video streaming,or a party game, and the personal information associated with a view isone of: incoming or outgoing phone calls, text messages, instantmessages, emails, or histories thereof. In some implementations, themedia content appropriate for a large group of viewers includes mediacontent associated with a group of viewers. In still otherimplementations, the media content appropriate for a large group ofviewers includes public media content associated with an individualviewer.

In addition, a computer system (e.g., a server system) and anon-transitory computer readable storage medium storing one or moreprograms, which when executed by a computer, cause the computer toperform one or more steps of the above-described methods are alsodisclosed.

DETAILED DESCRIPTION

The implementations described herein provide techniques for changing ormaintaining a TV operating mode in accordance with number of viewerspresent. For example, some implementations are configured to: (i) placethe TV in a personal mode in which the viewer's private information(e.g., incoming emails or recent viewing history) is displayed on the TVwhen only one viewer is present (i.e., located in proximity to the TV);(ii) place the TV in a shared mode in which a viewer's privateinformation is not displayed on the TV when two or three viewers arepresent; or (iii) place the TV in a party mode in which media contentassociated with one viewer (e.g., a YouTube video “liked” by thatviewer) is displayed on the TV for sharing with other viewers when fouror more viewers are present. Some implementations obtain how manyviewers are present using one or more techniques, some of which areautomated and some of which are manual. For example, automatedtechniques include sensing distinct bluetooth, wifi, mobile cellularradios, or NFC or RFID signals/tags in proximity to the TV or set topbox connected to the TV. Manual techniques include allowing a viewer toinput the number of viewers in the room on a remote control or aconnected smart phone. These implementations may significantly enhanceviewing experience for TV viewers, while still protect user privacy.

In some implementations, a supplemental set-top box (e.g., a GoogleTV-enabled device, or a set-top box with Internet connectivity) obtainsa total number of viewers of a connected TV, where the connected TV isconfigured to display one or more of: conventional TV content, contentor information provided via the Internet or a home network, and contentor information from devices paired with the TV, such as smart phones andtablet computers.

In some implementations, in accordance with a determination that thetotal number of viewers is within a first predefined range (e.g., 1) ofseveral predefined ranges, the electronic device places or maintains theconnected TV in or into a first operating mode (e.g., a personal mode)unrelated to media content being displayed on the connected TV.

In some implementations, in accordance with a determination that thetotal number of viewers is within a second predefined range (e.g., 2 to3, or 4 or more) of the several predefined ranges, the electronic deviceplaces or maintains the connected TV in or into a second operating mode(e.g., a shared mode or a party mode, respectively). The secondoperating mode is different from the first operating mode. In someimplementations, the operating mode is based solely on the number ofviewers present and is unrelated to any aspect of the media content(e.g., an audience suitability rating associated with the content).

In some implementations, when the TV is in the personal mode, personalinformation (e.g., incoming emails or instant messages) received from anexternal source (e.g., a viewer's smart phone or laptop) can bedisplayed on the connected TV. In some implementations, when the TV isin the shared mode, personal information received from an externalsource is not displayed, so as to protect viewer privacy. In someimplementations, when the TV is in the group mode, personal informationreceived from an external source is not be displayed on the connectedTV, but media content appropriate for a large group of viewers (e.g.,party music or music videos) is displayed on the connected TV.

In this way, a TV's operating mode and associated privacy settings areautomatically adjusted or maintained, without viewer intervention, basedon the number of viewers present. This approach is beneficial as itenhances the viewing experience while still protecting user privacy. Forexample, when acquaintances arrived unannounced, a user need notscramble through multiple levels of TV menus to prevent detailed viewinghistory or sensitive emails from being displayed on his or her TV.

Additional details of implementations are now described in relation tothe Figures.

FIG. 1 is a block diagram illustrating a computer system 100 forchanging or maintaining a TV operating mode in accordance with number ofviewers present. In some implementations, the computer system 100includes a display (or a TV) 120, a set-top box 130, a supplementalset-top box (“supplemental STB”) 102, (e.g., a Google TV-enabled device,a set-top box connected to either the TV or the Google-TV enableddevice, or a combination of the above), a communication network 104,optionally a server system 106 (“server 106”), and optionally one ormore consumer electronic devices 108 (“electronic device 108”; e.g.,electronic devices 108-A and 108-B), one or more of which is paired withthe TV. In some implementations, the combination of the display 120 andthe supplemental STB 102 is called a connected TV 132. In someimplementations, the supplemental STB 102 is integrated as part of thedisplay or TV 120.

In some implementations, the supplemental STB 102 includes a camera 110,an identification module 112, a mode switching module 114, a userinterface module 116, and a privacy control module 118. In someimplementations, the camera 110 is configured to capture automatically(e.g., without a user command to initiate the operation) facial or voicerecognition data, or simply images, of one or more viewers present(e.g., viewers within a predefined distance from or a predefined anglein relation to the TV). In some implementations, the identificationmodule 112 identifies a total number of viewers present and optionallyidentifies of these viewers, in accordance with, for example, the facialor voice recognition data generated by the camera 110. In someimplementations, the mode switching module 114, based on the total ofnumber of viewers, and optionally on the identities of these viewers,places or maintains the connected TV in one of a plurality of predefinedoperating modes. In some implementations, the user interface module 116,based on the operating mode in which a connected TV is, displaysdifferent user interface controls (e.g., an email application fordisplaying email content, a media player for displaying photos or videosor a text window for displaying texts sent to and from a paired smartphone). In some implementations, the privacy control module 118 appliesdifferent privacy settings to the connected TV in accordance with theoperating mode of the connected TV. In some implementations, the privacycontrol module 118 also applies different privacy settings to viewerpersonal information transferred from an external device (e.g., emailsreceived on a smart phone) to the connected TV, or information stored onthe connected TV (e.g., a viewer's recent viewing hi story).

In some implementations, the supplemental STB 102 is connected with aset-top box 130 using an HDMI connection (e.g., an HDMI cable). In someimplementations, the set-top box 130 receives media content from acontent provider, via a cable network or a satellite network.

In some implementations, the display 120 (e.g., a computer monitor or aconventional TV) displays media content (e.g., TV programming or aviewer's favorite YouTube videos), and optionally a viewer's personalinformation (e.g., a portion of an incoming email).

In some implementations, the supplemental STB 102 sends identificationdata 135 (e.g., facial recognition data generated by the camera 110) tothe server 106, and receives user identity information 137 from theserver 106. In some implementations, the supplemental STB 102 alsoreceives connection requests 136 from one or more electronic devices 108(e.g., a laptop or a smart phone), via a local connection 105, and inresponses to the connection requests 136, establishes connections withone or more of the electronic devices 108. In some implementations,sending of any user identification information to the server is strictlysubject to explicit user permission. For example, a user mustaffirmatively specify that she permits information identifying herlocation, viewing history, or home address to be sent to the server 106by turning on (e.g., checking on) one or more privacy settings.

In some implementations, the communication network 104 optionallyincludes the Internet, one or more local area networks (LANs), one ormore wide area networks (WANs), other types of networks, or acombination of such networks.

In some implementations, the local connection 105 optionally includesthe one or more local area networks (wired or wireless), bluetooth,radio-frequency connections, serial or parallel cable connections, othertypes of connections, or a combination of such connections.

In some implementations, the server 106 includes a viewer identitydatabase 122, and a viewer profile database 124. In someimplementations, the viewer identity database 122 includes informationconcerning viewer identifies (e.g., a viewer's name, photos, andoptionally relationship with another viewer), and the viewer profiledatabase 124 includes one or more viewer profiles. In someimplementations, a viewer profile includes a viewer's viewing history(e.g., what movies a viewer has watched in the past 48 hours), orviewing preference (e.g., a favorite type of movie). In someimplementations, a view profiles also includes a group profileidentifying view histories or preferences of a group of viewers (e.g.,viewers associated with a common social group or viewers within a samesocial circle). In some implementations, to balance processing work loadwith the supplemental STB 102, the server 106 optionally includes theidentification module 112, the mode switching module 114, the userinterface module 116, and the privacy control module 118.

In some implementations, the server 106 receives the identification data135 from the supplemental STB 102, identifies one or more viewers basedon the identification data 135 and data stored in the viewer identitydatabase 122, and transmits the user identity information 137 back tothe supplemental STB 102.

In some implementations, the electronic device 108 is a smart phone(e.g., an android phone), a laptop, a desktop, or an intelligent homeappliance (e.g., an intelligent refrigerator). In some implementations,the electronic device 108 is external to the supplemental STB 102 andconnects with the supplemental STB 102 via the local connection 105. Insome implementations, the electronic device 108 establishes a connectionwith the supplemental STB 102 by sending a connection request 136 to thesupplemental STB 102. In some implementations, the connection request136 includes authentication information (e.g., a device ID andcorresponding password) that enables the electronic device 108 to beconnected to the supplemental STB 102.

FIGS. 1B-1D are block diagrams illustrating example configurations of acomputer system for changing device operating mode in accordance withnumber of audience present.

A shown in FIG. 1B, in some implementations, the connected TV 132 isconnected to both a set-top box 130, and a server 106 via thecommunication network 104. As noted above, in some implementations, theconnected TV 132 includes both a display 120 or a TV, and thesupplemental STB 102. In some implementations, the connected TV 132obtains a total number of viewers who are present (e.g., using a cameraor microphone), and switches or maintains, without human intervention,into or in a particular operating mode in accordance with the totalnumber of viewers. Personal or private information received from theset-top box 130 (e.g., TV programming promotion based on past viewinghistory) is displayed or hidden from display on the connected TV 132,based on an operating mode in which the connected TV is in. In someimplementations, the server 106 provides viewer identity data or mediacontent (e.g., YouTube videos) for display on the connected TV 132.

A shown in FIG. 1C, in some implementations, the connected TV 132 isconnected with the set-top box 130 (e.g., via an HDMI cable), which isin turn connected with a server 106 (e.g., via the communication network104). In some implementations, the supplemental STB 102 included in theconnected TV 132 obtains a total number of viewers who are present(e.g., using a camera or microphone), and switches or maintains, withouthuman intervention, the connected TV 132 into or in a particularoperating mode in accordance with the total number of viewers. In someimplementations, personal or private information received from theserver 106 (e.g., personal emails, or TV programming promotions based onpast viewing history) is displayed or hidden from display on theconnected TV 132, based on an operating mode in which the connected TV132 is in. In some implementations, the server 106 provides vieweridentity data or media content (e.g., YouTube videos) for display on theconnected TV 132

As shown in FIG. 1D, in some implementations, modules included in thesupplemental STB 102 (e.g., the camera 110, the identification module112, the mode switching module 114, the user interface module 116, andthe privacy control module 118) are built into a phone 134. In someimplementations, the phone 134 is connected with a car radio 156 or anun-connected TV 136, with a sensor 138 (e.g., a weight sensor), and witha server 106 (e.g., via the communication network 104). In someimplementations, the phone 134 (e.g., a smart phone) obtains a totalnumber of passengers in a car from the sensor 138 or from the camera110. For example, based on how much weight is placed or a manner inwhich weight is placed on a car seat, the sensor 138 determines whethera passage is sitting on a car seat, and then the total number passengerspresent in a car. For another example, based on images taken by thecamera 110, the phone 134 determines whether a passage is sitting on acar seat, and then the total number passengers present in a car. Basedon the total number of passengers in the car, the phone 134 places ormaintains the car radio or the un-connected TV (e.g., a portable TV in acar) 136 into or in a particular operating mode. For example, when 4passengers are present in the car, the phone 134 places the car radio136 into a party mode (e.g., plays hip-hop music at the car radio). Foranother example, when only 1 passenger is present in the car, the phone134 places the car radio 136 into a personal mode (e.g., plays lightmusic at the car radio). In some implementations, the server 106provides media content (e.g., music or YouTube videos) for play on thecar radio or the un-connected TV 136.

FIG. 2 is a block diagram illustrating a supplemental set-top box 102(“supplemental STB 102”) in accordance with some implementations. Thesupplemental STB 102, in some implementations, includes one or moreprocessing units CPU(s) 202 (also herein referred to as processors, oneor more network interfaces 204, one or more user input devices 205,memory 206, the display 120, and one or more communication buses 208 forinterconnecting these components. The communication buses 208 optionallyinclude circuitry (sometimes called a chipset) that interconnects andcontrols communications between system components. The memory 206typically includes high-speed random access memory, such as DRAM, SRAM,or other random access solid state memory devices; and optionallyincludes non-volatile memory, such as one or more magnetic disk storagedevices, optical disk storage devices, flash memory devices, or othernon-volatile solid state storage devices. The memory 206 optionallyincludes one or more storage devices remotely located from the CPU(s)202. The memory 206, or alternatively the non-volatile memory device(s)within the memory 206, comprises a non-transitory computer readablestorage medium. In some implementations, the memory 206 or alternativelythe non-transitory computer readable storage medium stores the followingprograms, modules and data structures, or a subset thereof:

-   -   an operating system 210, which includes procedures for handling        various basic system services and for performing hardware        dependent tasks;    -   a network communication module (or instructions) 212 for        connecting the supplemental STB 102 with other devices (e.g.,        the server 106 or the electronic device 108-A) via one or more        network interfaces 204 (wired or wireless), or the communication        network 104 (FIG. 1);    -   an identification module 112 for identifying a total number of        viewers present and optionally identifies of these viewers,        which includes:        -   a facial recognition module 214 for collecting facial            recognition data (e.g., generated by the camera 110) of TV            viewers (who are present); and        -   a voice recognition module 214 for collecting voice            recognition data (e.g., generated by a microphone) of TV            viewers;    -   a mode switching module 114 for placing or maintaining the        connected TV or the display in or into a predefined operating        mode, based on the total number of viewers present and        optionally identifies of these viewers;    -   a user interface module 116 for displaying different user        interface control (displaying or hiding incoming email content)        in accordance with a particular operating mode of the connected        TV;    -   a privacy control module 118 for applying different privacy        settings to information transferred to (e.g., incoming emails)        or stored on (e.g., viewing histories) the connected TV, in        accordance with a particular operating mode of the connected TV;    -   data 218 stored on the supplemental STB 102, which include:        -   privacy settings 220, which include:            -   privacy setting 1 (222-1) associated with a first                operating mode of the connected TV, which includes:                -   a predefined range 224 (e.g., 1 or a single viewer)                    for the total number of viewers;                -   a private information setting 226 for displaying or                    hiding viewer private information (e.g., incoming                    emails or viewing history) on the connected TV; and                -   optionally a media content setting 228 for                    displaying or hiding viewer media content associated                    with a viewer (e.g., a YouTube video “liked” by a                    viewer) on the connected TV;            -   privacy setting 2 (222-2) associated with a second                operating mode of the connected TV; and            -   optionally privacy setting n (222-n) associated with a                n-th operating mode of the connected TV;        -   a total number of viewers 230 (e.g., the total number of            viewers with in a predefined distance from the connected TV            or viewers within a predefined angle to the connected TV);        -   identification data 135 for including data relevant to user            identities (e.g., facial or voice recognition data);        -   viewer identity information 137 for including identities of            one or more viewers (e.g., viewer names), and optionally an            existing relationship between two viewers (e.g., viewer 1 is            the girlfriend of viewer 2); and        -   connection request 136 for including one or more requests            (received from electronic devices 108) to connect with the            supplemental STB 102, and authentication data (e.g., device            ID or password) associated with these requests.

In some implementations, the one or more user input devices 205 includethe camera 110, and the microphone 111. In some implementations, thecamera 110 collects image data (e.g., relating to one or more viewersand to surrounding environment). In some implementations, the image dataof the viewers include viewer expressions (e.g., facial and body),viewer movements or gestures (e.g., eye and body movements), such as,looking up at the ceiling, looking down at the floor, looking sidewaysat an object other then the connected TV (all of which may be indicativeof a lack of, or diminished, user interest in the media content beingdisplayed on the connected TV), looking straight at the connected TV(which may be indicative of a strong user interest), waving left hand,nodding the head, stretching arms/legs, combing hairs, standing up,laying down in a couch, and sitting up tight in a chair. In someimplementations, the image data of the surrounding environment includeviewer location (e.g., in a kitchen area, in a bedroom, in a livingroom, and in a supermarket) or TV location (e.g., at a public airport, abus station, a train station, or a private residence). In someimplementations, the image data are used to determine the total numberof viewers present, e.g., using factual recognition techniques.

In some implementations, viewer movement (e.g., eye movement) orgestures are tracked (e.g., for purpose of controlling the connected TVor otherwise), only when expressly authorized by the viewers. Forexample, a viewer must first read a comprehensive disclosure on movementtracking (e.g., a user agreement) and specifically agree to be tracked,before motion or voice control functionality can be enabled on thesupplemental STB 102.

In some implementations, the microphone 111 collects voice data (e.g.,relating to one or more viewers and to surrounding environment). In someimplementations, the voice data of the viewers include characters,words, phrases, and sentences uttered (e.g., spoken) by the viewers, ora portion thereof. In some implementations, the voice data also includea tone or a manner in which the characters, words, phrases, andsentences are uttered or spoken (e.g., with anger or with joy, withurgency or with ease). In some implementations, the voice data are usedto determine the total number of viewers present, e.g., using voicerecognition techniques.

In some implementations, the supplemental STB 102 also includes one ormore media content inputs/outputs, and a TV remote control. In someimplementations, the TV remote control adjusts (e.g., fast-forward or-backward) media content being displayed on the connected TV 132. Insome implementations, the display 120 includes a TV screen or a computermonitor.

In some implementations, one or more of the above identified elementsare stored in one or more of the previously mentioned memory devices,and correspond to a set of instructions for performing a functiondescribed above. The above identified modules or programs (e.g., sets ofinstructions) need not be implemented as separate software programs,procedures or modules, and thus various subsets of these modules may becombined or otherwise re-arranged in various implementations. In someimplementations, the memory 206 optionally stores a subset of themodules and data structures identified above. Furthermore, the memory206 may store additional modules and data structures not describedabove.

FIGS. 2A-2C are block diagrams illustrating example privacy settings indifferent operating modes, in accordance with some implementations.

FIG. 2A shows example privacy settings when a connected TV is in thepersonal mode (e.g., when only 1 viewer is present), in accordance withsome implementations. As shown in FIG. 2A, the privacy settings includeprivate information settings for different categories of privateinformation, and values corresponding thereto (250). As shown in FIG.2A, in some implementations, when the connected TV is in the personalmode, incoming or outgoing text messages are displayed on the connectedTV (252), incoming or outgoing phone calls to a viewer's smart phone orinternet calls (e.g., Google voice calls) are displayed on the connectedTV (254). So are instant messages (e.g., received on a smart phone or alaptop connected to the connected TV) (254). In addition, the viewer'sviewing history (e.g., what movies or TV programs the viewer has watchedin the past week) is displayed on the connected TV (258), and theviewer's call history (260) and chat history (262) are also displayed.This approach may be beneficial, because it allows, when a viewer isalone by him- or herself, a viewer's private information to beconveniently displayed on a TV, which usually has more display realestate (e.g., larger screen). The viewer can glance over or reviewincoming emails while watching a favorite TV episode, without having toconstantly check emails on a phone or laptop. Viewing experience maythus be improved.

FIG. 2B shows example privacy settings when the connected TV is in theshared mode (e.g., when 2 to 3 viewers are present), in accordance withsome implementations. As shown in FIG. 2B, in some implementations, whenthe connected TV is in the shared mode, incoming or outgoing textmessages (254) are not displayed on the connected TV (e.g., onlydisplayed on the viewer's individual smart phone), to protect viewerprivacy. In some implementation, nor are incoming or outgoing phonecalls (254), instant messages (256), a viewer's viewing history (258),call history (260), and chat history (262). In some implementations,when in the shared mode, information that may be considered private orsensitive to a viewer (e.g., call history, chat history or viewinghistory) are not displayed or hidden from display on the connected TV soas to protect viewer privacy.

FIG. 2C shows example privacy settings when the connected TV is in theparty mode (e.g., 4 or more viewers are present), in accordance withsome implementations. As shown in FIG. 2C, in some implementations, whenthe connected TV is in the shared mode (e.g., 4 or more viewers arepresent), incoming or outgoing text messages (254), phone calls (254),instant messages (256), a viewer's viewing history (258), call history(260), and chat history (262) are not displayed (or are hidden fromdisplay) on the connected TV.

As also shown in FIG. 2C, in some implementations, the privacy settingsinclude private information settings (250), and media content settings(264). In some implementations, in the party mode, the media contentsettings (264) includes settings for public media content (e.g., photosor video a viewer has shared with other viewers, such as public photosstored on Google Picasa), and settings for private media content (e.g.,video a viewer has chosen not to share with other viewers). In someimplementations, in the party mode, public media content (266) isdisplayed on the connected TV, but private media content (268) is notdisplayed (or is hidden from display) on the connected TV.

In some implementations, a predefined operating mode is associated withdefault privacy settings. For example, privacy settings shown in FIG. 2Bare default settings under the shared mode. In some implementations,default privacy settings can be overridden by user entered values.

FIG. 3 is a block diagram illustrating another example supplemental STB102 A, in accordance with some implementations. The supplemental STB 102has similar components to those described with reference to FIG. 2. Insome implementations, the memory 206 or alternatively, thenon-transitory computer readable storage medium 206, stores programssimilar to those described with reference to FIG. 2, as well as thefollowing programs, modules and data structures, or a subset thereof:

-   -   a user interface module 116 for displaying different user        interface controls (e.g., a virtual keyboard or user selectable        on-screen icons) and receiving and outputting user interface        commands and feedback between one or more viewers and respective        user interface devices 207;    -   an input control module 232 for applying different control        settings to the one or more user input devices 207, including        enabling and disabling the use of different types of user input        devices 207, in accordance with a particular operating mode of        the connected TV;    -   data 218 stored on the supplemental STB 102, which include:        -   control settings 234, which include:            -   control setting 1 (222-1) associated with a first                operating mode of the connected TV, which includes:                -   a predefined range 224 (e.g., 1 or a single viewer)                    for the total number of viewers; and                -   a control setting 238 for controlling user input                    (via the one or more user input devices 207) to the                    connected TV;            -   control setting 2 (222-2) associated with a second                operating mode of the connected TV; and            -   optionally control setting n (222-n) associated with a                n-th operating mode of the connected TV;

In some implementations, the one or more user input devices 207 includethe camera 110, the microphone 111, a keyboard 113, a mouse 115, atouchscreen 117, and a trackpad 119.

In some implementations, one or more of the above identified elementsare stored in one or more of the previously mentioned memory devices,and correspond to a set of instructions for performing a functiondescribed above. The above identified modules or programs (e.g., sets ofinstructions) need not be implemented as separate software programs,procedures or modules, and thus various subsets of these modules may becombined or otherwise re-arranged in various implementations. In someimplementations, the memory 206 optionally stores a subset of themodules and data structures identified above. Furthermore, the memory206 may store additional modules and data structures not describedabove.

FIGS. 3A-3C are block diagrams illustrating example control settings indifferent operating modes, in accordance with some implementations.

As shown in FIG. 3D, in some implementations, a connected TV or asupplemental STB connoted thereto obtains (302) a total number ofviewers of the connected TV. After obtaining the total number ofviewers, the supplemental STB places or maintains (304) the connected TVin or into an operating mode in accordance with the total number ofviewer present.

In some implementations, the input control settings 234 are initiallyset to default values that are generally effective for the available TVoperating modes. For example, while voice input is effective in personal(i.e., one person) mode, voice input is generally not useful inmulti-user mode (i.e., when a large number of users are in proximity tothe TV being controlled). For this reason, in some implementations, thedefault settings for personal mode and multi-user mode respectivelyallow and exclude voice commands.

In some implementations, the supplemental STB applies (306) defaultcontrol or privacy settings (e.g., default values) associated with theoperating mode.

In some implementations, the supplemental STB enables or disables (308)a user input device in accordance with the default control settingsassociated with the operating mode (e.g., enabling or disabling voicecontrol as a means to control the connected TV). In someimplementations, the supplemental STB displays or hides (310) fromdisplay personal information on the connected TV in accordance with thedefault privacy settings associated with the operating mode.

In some implementations, the default input control setting values can bemodified by a primary registered viewer (e.g., to allow a large group toplay a party game that requires voice input), subject to privacyconcerns. In some implementations, moving between the different settingsand enabling and disabling the associated user interface devices areperformed under control of the input control module.

In some implementations, the supplemental STB obtains (312) a useroverride of a default control or privacy setting (e.g., a default value)associated with the operating mode. For example, a user would like toturn on voice control when there are 5 viewers present, even if bydefault, in the group mode, voice control is not enabled.

In some implementations, where the user overrides a default controlsetting, the supplemental STB enables or disables (314) a user input inaccordance with the user override (e.g., enabling or disabling voicecontrol as a means to control the connected TV). In someimplementations, where the user overrides a default privacy setting, thesupplemental STB displays or hides (316) from display personalinformation on the connected TV in accordance with the user override.

FIG. 3A shows example control settings when a connected TV is in thepersonal mode (e.g., when only 1 viewer is present), in accordance withsome implementations. As shown in FIG. 3A, the control settings includesettings for different means of controlling the connection TV, andvalues corresponding thereto (580). As shown in FIG. 3A, in someimplementations, under control of the input control module 232, when theconnected TV is in the personal mode, voice control (e.g., via hot wordsor key words) of the connected TV is enabled (282), motion control(e.g., gesture and eye movement) of the connected TV is enabled (284).So are the mouse control (286), the keyboard control (e.g., wired orwireless) (288), the touchscreen control (290), and the trackpad control(292) enabled. In addition, the control of the connected TV throughmultiple means is also enabled (294). In some implementations, controlthrough multiple means includes user control of the connected TV via twoor more of the above identified means, such as (i) concurrent control ofthe connected TV, using voice control (via the microphone 111 in FIG.3), and keyboard control (via the keyboard 113 in FIG. 2); and (ii)concurrent control of the connected TV, using voice control (via thecamera 110 in FIG. 3, which is equipped with audio recognitioncapacity), and motion control (via the same camera 110 in FIG. 3).

This approach allows a viewer, when alone, several ways to convenientlycontrol the connected TV. For example, when the viewer is preparing alate night dinner in her kitchen away from a mouse or a keyboard,because voice control is enabled, the viewer can still switch to adifferent TV channel using voice commands; e.g., by speaking, to thegeneral direction of the connect TV 132 or the microphone 111, atappropriate volume, “go to Law and Order,” or “play radio station NPR”In some implementations, a connected TV or a supplemental STB determinesan operating mode in accordance with the total number of viewerspresent, and loads control settings (e.g., settings 282-294 in FIG.3A-3C) automatically, without user intervention in accordance therewith.

FIG. 3B shows example control settings when the connected TV is in theshared mode (e.g., when 2 to 3 viewers are present), in accordance withsome implementations. As shown in FIG. 3B, when the connected TV is inthe shared mode (e.g., when 2 to 3 viewers are present, inclusive),voice control (e.g., via hot words or key words) of the connected TV isenabled (282). So are the mouse control (286), the keyboard control(e.g., wired or wireless) (288), the touchscreen control (290), and thetrackpad control (292) enabled. In some implementations, the motioncontrol (e.g., gesture and eye movement) of the connected TV, however,is not enabled (e.g., disabled) (284). In addition, in someimplementations, the control through multiple means is also not enabled(e.g., disabled) (294).

FIG. 3C shows example control settings when the connected TV is in theparty mode (e.g., 4 or more viewers are present), in accordance withsome implementations. As shown in FIG. 3C, in some implementations, whenthe connected TV is in the shared mode (e.g., 4 or more viewers arepresent), the voice control (282), the motion control (284), and thecontrol through multiple means (294) are not enabled, because e.g., itmay be difficult to detect voice or motion control commands from 4 ormore viewers simultaneously, due to an increased likelihood ofvoice/motion overlap. In some implementations, the mouse control (286),the keyboard control (288), the touchscreen control (290), and thetrackpad control (292) are enabled.

In some implementations, a user input device is partially enabled ordisabled in accordance with an operating mode. In some implementations,in the group mode, voice or motion control of the connected TV ispartially enabled, disabled, or modified. For example, when switching aconnected TV from a personal mode into a group mode, some aspects of thevoice control (e.g., voice control functionalities requiring complicatedor lengthy keywords, such as “go to radio station FM 103.65” or “go toTV, Law and Order, season 1, episode 10”) are disabled; while some otheraspects of the voice control remain enabled (e.g., voice controlfunctionalities requiring only simple keywords, such as “Radio” and “TV”remain enabled). For another example, when switching a connected TV froma personal mode into a shared mode, some aspects of the motion control(e.g., raising the left arm and stretching the right left legsimultaneously to initiate a search for web content, such as movietrailers on YouTube.com, which are relevant to media content beingdisplayed on the connected TV) are disabled; while some other aspects ofthe motion control (e.g., a single hand-swiping gesture to signal aswitch to next TV channel) remain enabled.

In some implementations, a predefined operating mode is associated withdefault control settings. For example, control settings shown in FIG. 3Bare default settings under the shared mode. In some implementations,default control settings can be overridden by user entered values.

FIG. 4 is a block diagram illustrating the server system 106 (“server106,” also called a server), in accordance with some implementations.The server 106 typically includes one or more processing units CPU(s)402 (also herein referred to as processors), one or more networkinterfaces 404, memory 406, and one or more communication buses 408 forinterconnecting these components. The communication buses 408 optionallyinclude circuitry (sometimes called a chipset) that interconnects andcontrols communications between system components. The memory 406includes high-speed random access memory, such as DRAM, SRAM, DDR RAM orother random access solid state memory devices; and optionally includesnon-volatile memory, such as one or more magnetic disk storage devices,optical disk storage devices, flash memory devices, or othernon-volatile solid state storage devices. The memory 406 optionallyincludes one or more storage devices remotely located from CPU(s) 402.The memory 406, or alternatively the non-volatile memory device(s)within the memory 406, comprises a non-transitory computer readablestorage medium. In some implementations, the memory 406 or alternativelythe non-transitory computer readable storage medium stores the followingprograms, modules and data structures, or a subset thereof:

-   -   an operating system 410, which includes procedures for handling        various basic system services and for performing hardware        dependent tasks;    -   a network communication module (or instructions) 412 for        connecting the server 106 with other devices (e.g., the        supplemental STB 102) via the one or more network interfaces 404        (wired or wireless), or the communication network 104 (FIG. 1);    -   a view identity database 122 for including information relating        to viewer identifies (e.g., a viewer's name, or photos);    -   a viewer profile database 124 for including one or more viewer        profiles (e.g., a viewer's favorite movie genres, or a social        circle or group with which a viewer is affiliated);    -   a media content database 414 for including media content (e.g.,        photos, songs, YouTube videos, movies or TV episodes) associated        with a viewer (e.g., stored on a viewer's smart phone, or        uploaded with the viewer's YouTube account);    -   data 416 stored on the server 106, which include:        -   identification data 135 for including data relevant to user            identities (e.g., facial or voice recognition data); and        -   viewer identity information 137 for including viewer            identities (e.g., names), and optionally an existing            relationship between two viewers (e.g., viewer 1 is the            girlfriend of viewer 2);    -   optionally an identification module 112, which includes:        -   a facial recognition module 214 for collecting facial            recognition data (e.g., generated by the camera 110) of TV            viewers; and        -   a voice recognition module 214 for collecting voice            recognition data (e.g., generated by a microphone) of TV            viewers;    -   optionally a mode switching module 114 for placing or        maintaining the connected TV in or into a predefined operating        mode, based on the total number of viewers present and        optionally identifies of these viewers;    -   optionally a user interface module 116 for displaying different        user interface control (displaying or hiding incoming email        content) in accordance with a particular operating mode of the        connected TV; and    -   optionally a privacy control module 118 for applying different        privacy settings to information transferred to (e.g., incoming        emails) or stored on (e.g., viewing history) the connected TV,        in accordance with a particular operating mode of the connected        TV.

In some implementations, one or more of the above identified elementsare stored in one or more of the previously mentioned memory devices,and corresponds to a set of instructions for performing a functiondescribed above. The above identified modules or programs (e.g., sets ofinstructions) need not be implemented as separate software programs,procedures or modules, and thus various subsets of these modules may becombined or otherwise re-arranged in various implementations. In someimplementations, the memory 406 optionally stores a subset of themodules and data structures identified above. Furthermore, the memory406 optionally stores additional modules and data structures notdescribed above.

Although FIG. 4 shows a “server system 106,” also referred to as aserver, FIG. 4 is intended more as functional description of the variousfeatures which may be present in server system than as a structuralschematic of the implementations described herein. In practice, and asrecognized by those of ordinary skill in the art, items shown separatelycould be combined and some items could be separated.

FIG. 5 is a flow chart illustrating a method 500 for changing TVoperating mode in accordance with number of viewers present in acomputer system, in accordance with some implementations. In someimplementations, the method 500 is performed at the supplemental STB 102(or at the connected TV 132).

In some implementations, the supplemental STB 102 first displays (502)media content (e.g., photos, songs, YouTube videos, movies or TVepisodes) on a connected TV. In some implementations, while stilldisplaying the media content, the supplemental STB 102 collects (504),via the camera 110 or a microphone, facial or voice recognition dataassociated with one or more viewers who are present. In someimplementations, a viewer is considered to be present, if the viewer iswithin a predefined distance (e.g., less than 7 feet) from the connectedTV, or within a predefined angle (e.g., at least 25 degrees) to theconnected TV.

In some implementations, after collecting (504) the facial or voicerecognition data associated with the viewers, the supplemental STB 102obtains (506) a total number of viewers of the connected TV. In someimplementations, the supplemental STB 102 determines the total number ofviewers using the facial or voice recognition data. In otherimplementations, the supplemental STB 102 obtains the total number ofviewers from the server 106.

In some implementations, obtaining (506) the total number of viewers ofthe connected TV, at the supplemental STB 102 or at the server 106,includes: collecting facial or voice recognition data associated withthe viewers using the camera 110 or a microphone, and determining thetotal number of viewers of the connected TV based on the facial or voicerecognition data (e.g., by comparing the facial or voice recognitiondata with data stored in the view identity database 122). In someimplementations, obtaining (506) the total number of viewers of theconnected TV includes: collecting information identifying one or moreconsumer electronic devices associated with the viewers; and determiningthe total number of viewers of the connected TV based on the informationidentifying the consumer electronic devices. For example, thesupplemental STB 102 analyzes the connection requests 136 (part of thedata 218 stored on the supplemental STB 102) stored in a log file or alookup table, and determines a number of consumer electronic devices(e.g., smart phones or laptops belonged to different viewers) that haveconnected with the supplemental STB 102, via the local connection 105.In still other implementations, obtaining (506) the total number ofviewers of the connected TV includes: collecting a user input indicatingthe total number of viewers of the connected TV. For example, in someimplementations, a user manually enters the total number of viewers,through a menu displayed on the connected TV (e.g. when the camera 110is not working properly or when a viewer desires to switch off thefacial or voice recognition feature).

In some implementations, after determining the total number of viewersof the connected TV, the supplemental STB 102 also identifies apotential relationship among the viewers (e.g., whether the fourreviewers who are present have elected to share some or all privateinformation among themselves), or a subset of the viewers (e.g., asimilar relationship between two of the four viewers).

In some implementations, after determining the total number of viewersof the connected TV, the supplemental STB 102 also obtains identitiesassociated with the viewers of the connected TV. In someimplementations, the supplemental STB 102 obtains viewer identities by:(i) collecting facial or voice recognition data associated with theviewers (e.g., collecting a photo of a viewer's face, or an audio clipof a viewer's voice), and comparing the collected facial or voicerecognition data with a user identity database (e.g., the vieweridentity debase 122); or (ii) collecting information identifying one ormore consumer electronic devices (e.g., device ID, a smart phone's SIMcard number, or a MAC address of a laptop or desktop computer)associated with the viewers, and comparing the collected informationwith a device database (e.g., a database including information thatidentifies a device, a smart phone or a laptop, as belonged to aparticular viewer).

In some implementations, the supplemental STB 102 then places ormaintains the connected TV in or into a respective operating mode of theplurality of operating modes, in accordance with the total number ofviewers and the viewer identities. For example, when the supplementalSTB 102 identifies that there are two viewers present, Tom and Jerry,both of whom have shared all private information with each other(temporarily or permanent), the supplemental STB 102 places or maintainsthe connected TV in the personal mode (as opposed to the shared mode),so that a text message Tom receives on his smart phone would bedisplayed on the connected TV (e.g., accessible to Jerry).

In some implementations, where two or more viewers (e.g., a first viewerA and a second viewer B) are present, the supplemental STB 102 firstdetermines identity of the first viewer A, and then determines identityof the second viewer B. In some implementations, the supplemental STB102 further determines a potential relationship between the first andsecond viewers based on the identities of the first and secondviewers—e.g., whether the viewer A is a family member of the viewer B,whether the viewer A shares a same social circle with the viewer B, orwhether the viewer A has shared all his or her private information(e.g., emails) or private media content (e.g., YouTube video) with theviewer B—and placing or maintaining the connected TV in or into arespective operating mode of the plurality of operating modes, inaccordance with the potential relationship. These approaches arebeneficial because they renders privacy settings associated with aparticular operating mode flexible: default privacy settings can beoverridden without human intervention, temporarily or permanently, basedon user identities or based on a potential relationship between twoviewers. For example, if the viewer A has always forward his or herincoming emails and text messages to the viewers B, the supplemental STB102, in some implementations, places the connected TV in the personalmode (as opposed to the shared mode) even when both the viewer A and theviewer B are present.

Alternatively, in other implementations, the supplemental STB 102obtains the total number of viewers from the server 106. In otherimplementations, the supplemental STB 102 transmits the facial or voicerecognition data collected to the server 106. In some implementations,the server 106 then determines the total number of viewers who arepresent, in accordance with the facial or voice recognition datareceived from the supplemental STB 102.

In some implementations, in addition to determining the total number ofviewers, the server 106 also determines (512) viewer identities based onthe facial or voice recognition data. In some implementations, theserver 106 determines (512) viewer identities by comparing the facial orvoice recognition data received from the supplemental STB 102 with datastored in the viewer identity database 122. In some implementations,after having determined viewer identities, the server 106 identifies(514) a potential relationship among the viewers or a subset of theviewers (e.g., whether the viewers who are present have shared some orall their private information among each other). In someimplementations, the server 106 then sends (516) information identifyingthe viewer identities and optionally the identified relationship, to thesupplemental STB 102, for further processing.

In some implementations, after obtaining (506) the total number ofviewers present, the supplemental STB 102 determines (508) whether thetotal number of viewers is within a predefined range (e.g., 1, 2-3, or 4or more).

In some implementations, based on the viewer identity information 137,the supplemental STB 102 further determines (510) or ascertainsidentities of the viewers who are present. For example, using the vieweridentities information 137 received from the server 106, thesupplemental STB 102 determines the viewer directly sitting in front ofthe connected TV is Andy, the viewer standing at roughly 30 degrees tothe TV is Doug, and the viewer sitting on a sofa but facing away fromthe TV is Gilbert.

In some implementations, in accordance with the total number of viewerspresent, the supplemental STB 102 then places or maintains (518) theconnected in or into a respective operating mode. For example, when thetotal number of viewers is 2 (e.g., both viewer A and viewer B arepresent), the supplemental STB 102 places or maintains the connected TVin the shared mode, and as a result, and incoming instant messagesaddressed to the viewer A are not displayed on the connected TV.

In some implementations, in accordance with the total number of viewerspresent and optionally the viewer identities, the supplemental STB 102places or maintains (518) the connected in or into a respectiveoperating mode. For example, when the total number of viewers is 2(e.g., both viewer A and viewer B are present), and the viewer A isviewer B's 10-month old baby son (who cannot yet read), the supplementalSTB 102 places or maintains the connected TV in the personal mode (asopposed to the shared mode), and as a result, incoming chat messages forthe viewer B are displayed on the connected TV even though the viewer Ais also present.

In some implementations, after placing or maintaining (518) theconnected in or into a respective operating mode, the supplemental STB102 identifies a particular individual (e.g., an individual who shouldbe but is not yet present) based on the information identifying the oneor more viewers (e.g., a Gmail invite to watch a movie together, whichhas been accepted not only by the viewers who are present but also bythe individual who is not yet present), and sends a reminder to theparticular individual of an event associated with the one or moreviewers (e.g., sending a Gmail reminder to individual(s) who are not yetpresent, remaindering them that the movie is about to begin at aspecific time).

FIG. 6 is a flow chart illustrating a method 600 for changing TVoperating mode in accordance with number of viewers present, at asupplemental STB, in accordance with some implementations. In someimplementations, the method 600 is performed at the supplemental STB 102or at the connected TV 132.

In some implementations, the supplemental STB 102 obtains (602) a totalnumber of viewers of a connected TV, which has a plurality of operatingmodes (e.g., including a personal mode, a share mode, and a party mode).In some implementations, the total number is one (e.g., a single vieweris present). In some implementations, the total number is two to threeinclusive, or four or more.

In some implementations, where the supplemental STB 102 is equipped withappropriate processing power, the supplemental STB 102 determines (604)the total the total number of viewers (e.g., using the identificationmodule 112). In other implementations, where processing at a server isdesired, the supplemental STB 102 obtains (602) the total the totalnumber of viewers from the server 106, which determines the total numberof viewers based on the facial (or voice) recognition data received fromthe supplemental STB 102.

In some implementations, in accordance with the total number of viewers,the supplemental STB 102 then places or maintains the connected TV in orinto a respective operating mode of a plurality of predefined operatingmodes. In some implementations, the plurality of predefined rangesincludes: a predefined range (e.g., 1) for one viewer, a predefinedrange (e.g., 2-3, inclusive) for a small group of viewers, and apredefined range (e.g., 4 or more) for a large group of viewers.

In some implementations, the operating modes are unrelated to (orindependent from) media content displayed on the connected TV (e.g.,changing operating mode of the connected TV does not necessarily changethe media content on the TV). For example, while viewer A is watching aLaw and Order episode on her Google TV in her living room, viewer Benters living room and sits down next to the viewer A. After detectingthat the total number of viewers is now two (both the viewer A and theviewer B are now present), the supplemental STB 102—without interruptingthe Law and Order episode being displayed on the Google TV—switches theconnected TV into the shared mode (from the personal mode). Thisapproach, changing operating mode of the connected TV without changingthe media content displayed thereon, is beneficial, because it enhancesviewing experience (e.g., by not interrupting the display of the mediacontent) and protects user privacy (e.g., the viewer B is less likely tonotice the operating mode of the TV has changed because the mediacontent displayed on the TV was not interrupted).

In some implementations, in accordance with a determination that thetotal number of viewers, is within a first predefined range of aplurality of predefined ranges (e.g., 1, or 2-3 inclusive), thesupplemental STB 102 places or maintains (606) the connected TV in orinto a first operating mode (e.g., the personal mode or the shared mode,respectively) unrelated to media content being displayed on theconnected TV (e.g., without interrupting a Law and Order episode beingwatched by the viewer A). In some implementations, an operating mode ofthe connected TV being unrelated to the media content being displayed onthe TV means that a change in the TV's operating mode does notnecessarily change or interrupt the media content being display on theTV, and because there being no change or interruption in the mediacontent, some viewers are sometimes not aware of an operating modechange.

For example, while viewer A is, in her living room, watching a SouthPark episode on a connected TV that in the personal mode, viewer B, anacquaintance of the viewer A, steps into the living room; afterdetecting the presence of viewer B, the connected TV switches into theshared mode (from the personal mode) without causing any interruption tothe South Park episode being displaying on the TV (e.g., by displaying aconspicuous—large or persistent—on-screen reminder that a mode switch istaking or has taken place). These features are useful, because theyavoid any potential embarrassments to viewers who do not want otherviewers to know that a change in operating mode of the connected TV istaking place, because in some situations, a viewer may be embarrassedby, upon the arrival or appearance or another person, having to scrambleto turn off the display of her personal information on a TV, a sign thatmay be interpreted, albeit erroneously or mistakenly, as attempting tohide something from the other person (such as, an acquaintance, a friendor a family member).

In some implementations, in accordance with a determination that thetotal number of viewers is within a second predefined range (e.g., 2-3inclusive, or 4 or more) of the plurality of predefined ranges, thesupplemental STB 102 places or maintains (608) the connected TV in orinto a second operating mode (the shared mode or the party mode,respectively) unrelated to the media content. In some implementations,the second operating mode is different from the first operating mode.

In some implementations, in accordance with a determination that thetotal number of viewers is within a third predefined range (e.g., 4 ormore, or 1) of the plurality of predefined ranges, the supplemental STB102 places or maintains (610) the connected TV in or into a thirdoperating mode (the party mode or the personal mode, respectively)unrelated to the media content. In some implementations, the thirdoperating mode is different from the first and second operating modes.

For example, in some implementations, the supplemental STB 102 places ormaintains the connected TV in or into the personal mode when the totalnumber of viewers is 1; in some implementations, the supplemental STB102 places or maintains the connected TV in or into the shared mode whenthe total number of viewers is 2 to 3; and in some implementations, thesupplemental STB 102 places or maintains the connected TV in or into theparty mode when the total number of viewers is 4 or more.

In some implementations, a respective operating mode of the plurality ofoperating modes is associated with different privacy settings. Forexample, in some implementations, privacy settings associated with thepersonal mode of the connected TV (e.g., in FIG. 2A, in the category“Call history,” the setting “Display on TV=Yes”) are different fromthose associated with the shared mode (e.g., in FIG. 2B, in the category“Call history,” the setting “Display on TV=No”).

In some implementations, in the personal mode, personal informationreceived from an external source can be displayed on the connected TV(e.g., incoming emails received on a smart phone can be displayed on theTV). In some implementations, in the shared mode, personal informationreceived from an external source may not be displayed on the connectedTV (e.g., incoming emails received on a smart phone may not be displayedor are hidden from display on the TV). In some implementations, in thegroup mode, personal information received from an external source maynot be displayed on the connected TV (e.g., incoming emails received ona smart phone is not displayed or is hidden from display on the TV), andmedia content appropriate for a large group of viewers (e.g., a partyvideo or a hip-hop music TV) is displayed on the connected TV.

In some implementations, personal or private information associated witha view is one of: incoming or outgoing phone calls, text messages,instant messages, emails, or histories thereof (messaging history, callhistory, or email history). In some implementations, the media contentappropriate for a large group of viewers is one of: a photo slideshow,an audio and video streaming, or a party game.

In some implementations, the media content appropriate for a large groupof viewers includes media content associated with a group of viewers.For example, in some implementations, the media content appropriate fora large group of viewers includes media content “liked” (or consideredas favorite) by more than a predefined number of viewers in a samesocial circle (e.g., a G+ circle). In other implementations, the mediacontent appropriate for a large group of viewers includes public mediacontent associated with an individual viewer (e.g., this is indicated bythe “Display on TV=Yes” setting 266 in FIG. 2C). For example, in someimplementations, the media content appropriate for a large group ofviewers includes: media content offered for share by a viewer with otherviewers (e.g., a YouTube video sent to other viewers using arecommendation function), or media content made public by a viewer(e.g., a viewer's public photo albums on Google Picasa). In someimplementations, the media content appropriate for a large group ofviewers does not include (or excludes): private media content associatedwith a viewer. For example, in some implementations, the media contentappropriate for a large group of viewers does not include or excludes aviewer's private photo albums on Google Picasa, or YouTube video aviewers has uploaded to the internet but kept as private (e.g., this isindicated by the “Display on TV=No” setting 268 in FIG. 2C).

In some implementations, a respective operating mode of the plurality ofoperating modes is associated with different control settings. Forexample, in some implementations, control settings associated with thepersonal mode of the connected TV (e.g., in FIG. 3A, in the category“Motion control,” the setting “Control enabled=Yes”) are different fromthose associated with the shared mode (e.g., in FIG. 3B, in the category“Motion control,” the setting “Control enabled=No”).

In some implementations, in the personal mode, voice or motion controlof the connected TV is enabled. For example, when a viewer is alone byhimself or herself, the viewer can control the connected TV (e.g.,turning the TV on/off, switching to a different channel, or turningvolume up/down) and one or more devices connected thereto (e.g., a DVDplayer, a BlueRay player, a sound system, a WII device, a SONY PLAYSTATION, or a VCD player) using voice commands or gestures. Thisapproach is advantageous, because it affords a viewer more flexibilityin controlling the connected TV. For example, when a viewer is watchingthe TV while talking to a customer service agent on a cell phone, and isthus unable to control the TV by voice (e.g., by voice commands), theviewer can use motions or gestures to control the TV, e.g., by movingher right hand from the right to the left or mimicking a page-turninggesture, to effect a switch to the immediate next channel.

In some implementations, in the group mode (e.g., when 4 or more viewersare present), voice or motion control of the connected TV is not enabled(e.g., disabled). For example, when a viewer is watching an NFL gametogether with her extended family (e.g., including 5 or more relatives),neither the viewer nor the relatives can control the connected TV byvoice (e.g., by speaking the phrase “turn up the volume”) or by motion(e.g., by raising a left hand up above the head, to increase thevolume). This approach is advantageous, because in situations where anumber of viewers are present, voice or motion (e.g., gesture) overlapsmay be rampant, which may result in confusion at the supplemental STB(e.g., as to what viewer intentions are) and consequently a non-optimalviewing experience.

For example, viewer A, attempting to increase volume of a connected TV,utters the phrase “volume UP,” which the supplemental STB interprets asa user (voice) command to turn the volume up on the TV; at or around thesame time, however, viewer B, feeling an arm pain, begins to movequickly his right arm up and down, which the supplemental STB interpretsas a user (gesture) command to turn the volume down on the TV. Havingreceived both commands, in some cases, the STB might not effect a volumechange (e.g., when the receipt of two conflicting commands results inthe cancellation of both commands); while in other cases, thesupplemental STB might first increase the TV volume (e.g., in responseto voice control by the viewer A), but then immediately decrease the TVvolume (e.g., in response to the arm motion gesture by the viewer B).Neither response by the supplemental STB (e.g., no action, or turningthe volume up then down) is desired, these such controls are disabled.

In some implementations, voice or motion (e.g., gesture) control of theconnected TV is transferred or maintained, based on viewer identity. Insome implementations, a particular individual, among a plurality ofindividuals, is first identified, based on the information identifyingthe one or more viewers. In some implementations, control of theconnected TV is transferred or maintained in accordance with theidentification of the particular individual.

For example, when 3 viewers (viewers A, B, and C) are present at aliving room of an apartment, the supplemental STB identifies (using acamera and facial recognition techniques) that viewer A is the owner ofthe apartment, and that viewers B and C are guests. In accordance withthese identification, when conflicting commends are receiving (e.g., theviewer A would like to switch to the Fox News channel, while the viewerB would like to switch to the MSNBC channel), the supplemental STB takesaction in accordance with the control by the viewer A (e.g., switchingto the Fox News channel), and disregards the (attempted) control by theviewer B.

For another example, when a 7-person family (viewers A, B, C . . . , andG) is present in their living room watching an NFL game, afteridentifying (using the camera, and facial recognition techniques) thatviewers A and B are the parents of viewers C . . . , and G, thesupplemental STB allows control of the connected TV be transferredautomatically between the viewers A and B, but would not transfer thecontrol of the TV to other viewers (e.g., the viewer C, the eldestchildren), unless specifically requested (e.g., by the viewer A or B).

This approach is advantageous, because it restricts control to theconnected TV to a relatively small number of viewers, thereby minimizingthe occurrences of conflicting commands and confusion resulting therefrom; and because it enables features similar to parental control.

FIG. 7 is a block diagram illustrating an example functional diagramillustrating operations or modules used in a supplemental STB that areconfigured to change operating modes of a TV based on the number ofviewers present, in accordance with some implementations.

As shown in FIG. 7, in some implementations, the supplemental STB 102includes a smart TV operating system 724 (e.g., a Google TV operatingsystem), which executes the method 500 or 600 described above, in fullor in part. In some implementations, the supplemental STB 102 includes acamera module 704, which in turn includes a face detection module 702.In some implementations, the supplemental STB 102 uses facial detectiondata generated by the camera module 704 to obtain a total number ofviewers who are present (e.g., a number of faces 705). In someimplementations, the supplemental STB 102 places or maintains aconnected TV into one of several operating modes, in accordance with thetotal number of viewers who are present.

In some implementations, in accordance with a determination that thetotal number of viewer(s) is 1, the supplemental STB 102 places ormaintains the connected TV into or in a single mode (e.g., the personalmode) 706. In some implementations, when the connected TV is in thesingle (or personal) mode 706, the supplemental STB 102 applies privacysettings 708 (e.g., settings 252-262 in FIG. 2A) associated with thesingle mode to private information received at the connected TV from anexternal device (e.g., incoming emails received from a smart phone aredisplayed on the connected TV).

In some implementations, when connected with two or more electronicdevices 102 (e.g., smart phones), the supplemental STB 102 processescontrol commands received from multiple electronic devices 102 (e.g.,smart phones), e.g., on a first come first server basis or a prioritybasis. In some implementations, when in the party mode, the supplementalSTB 102 allows connection to a single electronic device 102, to reducesecurity risk (e.g., to avoid security breach to the supplemental STB102 or to a personal computer within the same local area network).

In some implementations, when the connected TV is located in a publicarea (e.g., at a supermarket, at an air port, at a public library, orinside an air plane), the supplemental STB 102 restricts connection topredefined electronic devices 102 (e.g., a testing device being used bya maintenance worker, or a remote control device with appropriatesecurity credentials), in according with a device identifier, so as toprovide enhanced security or access control as to which users or whatdevices can connect to and play media content on the connected TV. Insome implementations, the device identifier is a MAC address (e.g., fora computer), an IMEI number (e.g., for a cell phone), or a user name orlogin.

In some implementations, when the connected TV is in the single mode(e.g., the personal mode) 706, the supplemental STB 102 configures orformats a default user interface 710 for display on the connected TV.For example, the default user interface 710, in the single (or personal)mode, includes menus for accessing recent viewing history or callhistory on the connected TV.

In some implementations, in accordance with a determination that thetotal number of viewers is 2 to 3 inclusive, the supplemental STB 102places or maintains the connected TV into or in a shared mode 712. Insome implementations, when the connected TV is in the shared mode 712,the supplemental STB 102 applies privacy settings 714 (e.g., settings252-262 in FIG. 2B) associated with the shared mode to privateinformation received at the connected TV from an external device (e.g.,incoming emails received from a smart phone are not displayed on theconnected TV). In some implementations, when the connected TV is in theshared mode 712, the supplemental STB 102 configures or formats a seconddefault user interface 716 for display on the connected TV. For example,the second default user interface 716, in the shared mode, does notinclude (or include non-actionable or grayed-out) menus for accessingrecent viewing history or call history on the connected TV.

In some implementations, in accordance with a determination that thetotal number of viewers is 4 or more, the supplemental STB 102 places ormaintains the connected TV into or in a party mode 718. In someimplementations, when the connected TV is in party mode 718, thesupplemental STB 102 applies privacy settings 720 (e.g., settings252-262 and 266-268 in FIG. 2C) associated with the party mode toprivate information received at the connected TV from an external device(e.g., incoming emails received from a smart phone are displayed on theconnected TV). In some implementations, when the connected TV is in theparty mode 718, the supplemental STB 102 configures or formats a thirddefault user interface 722 for display on the connected TV. For example,the third default user interface 722, in the party mode, does notinclude (or include non-actionable or grayed-out) menus for accessingrecent viewing history or call history on the connected TV, but includesmenus (e.g., a media player or a multi-player game) for displaying mediacontent appropriate for a large group of viewers on the connected TV.

Plural instances may be provided for components, operations orstructures described herein as a single instance. Finally, boundariesbetween various components, operations, and data stores are somewhatarbitrary, and particular operations are illustrated in the context ofspecific illustrative configurations. Other allocations of functionalityare envisioned and may fall within the scope of the implementation(s).In general, structures and functionality presented as separatecomponents in the example configurations may be implemented as acombined structure or component. Similarly, structures and functionalitypresented as a single component may be implemented as separatecomponents. These and other variations, modifications, additions, andimprovements fall within the scope of the implementation(s).

It will also be understood that, although the terms “first,” “second,”etc. may be used herein to describe various elements, these elementsshould not be limited by these terms. These terms are only used todistinguish one element from another. For example, a first predefinedrange could be termed a second predefined range, and, similarly, asecond predefined range could be termed a first predefined range, whichchanging the meaning of the description, so long as all occurrences ofthe “first predefined range” are renamed consistently and alloccurrences of the “second predefined range” are renamed consistently.The first predefined range, and the second predefined range are bothpredefined ranges, but they are not the same predefined range.

The terminology used herein is for the purpose of describing particularimplementations only and is not intended to be limiting of the claims.As used in the description of the implementations and the appendedclaims, the singular forms “a”, “an” and “the” are intended to includethe plural forms as well, unless the context clearly indicatesotherwise. It will also be understood that the term “and/or” as usedherein refers to and encompasses any and all possible combinations ofone or more of the associated listed items. It will be furtherunderstood that the terms “comprises” and/or “comprising,” when used inthis specification, specify the presence of stated features, integers,steps, operations, elements, and/or components, but do not preclude thepresence or addition of one or more other features, integers, steps,operations, elements, components, and/or groups thereof.

As used herein, the term “if” may be construed to mean “when” or “upon”or “in response to determining” or “in accordance with a determination”or “in response to detecting,” that a stated condition precedent istrue, depending on the context. Similarly, the phrase “if it isdetermined (that a stated condition precedent is true)” or “if (a statedcondition precedent is true)” or “when (a stated condition precedent istrue)” may be construed to mean “upon determining” or “in response todetermining” or “in accordance with a determination” or “upon detecting”or “in response to detecting” that the stated condition precedent istrue, depending on the context.

The foregoing description included example systems, methods, techniques,instruction sequences, and computing machine program products thatembody illustrative implementations. For purposes of explanation,numerous specific details were set forth in order to provide anunderstanding of various implementations of the inventive subjectmatter. It will be evident, however, to those skilled in the art thatimplementations of the inventive subject matter may be practiced withoutthese specific details. In general, well-known instruction instances,protocols, structures and techniques have not been shown in detail.

The foregoing description, for purpose of explanation, has beendescribed with reference to specific implementations. However, theillustrative discussions above are not intended to be exhaustive or tolimit the implementations to the precise forms disclosed. Manymodifications and variations are possible in view of the aboveteachings. The implementations were chosen and described in order tobest explain the principles and their practical applications, to therebyenable others skilled in the art to best utilize the implementations andvarious implementations with various modifications as are suited to theparticular use contemplated.

What is claimed is:
 1. A method, comprising: at a computing devicehaving one or more processors and memory storing one or more programsfor execution by the one or more processors: determining identities ofviewers of a connected TV, the connected TV having a plurality ofoperating modes; identifying a potential relationship among the viewersbased on the identities of the viewers; in accordance with adetermination that the potential relationship allows the viewers toshare private information: automatically, without human intervention,placing or maintaining the connected TV in or into a first operatingmode unrelated to media content being displayed on the connected TV,wherein while in the first operating mode personal information can bedisplayed on the connected TV; and in accordance with a determinationthat the potential relationship does not allow the viewers to shareprivate information: automatically, without human intervention, placingor maintaining the connected TV in or into a second operating modeunrelated to the media content; wherein the second operating mode isdifferent from the first operating mode, wherein while in the secondoperating mode personal information may not be displayed on theconnected TV.
 2. The method of claim 1, further comprising: obtainingthe identities associated with the viewers of the connected TV by: (i)collecting facial or voice recognition data associated with the viewers;and comparing the collected facial or voice recognition data with aviewer identity database; or (ii) collecting information identifying oneor more consumer electronic devices associated with the viewers; andcomparing the collected information with a device database.
 3. Themethod of claim 1, further comprising: determining or obtaining a totalnumber of viewers of the connected TV, wherein the total number is oneor more; wherein in accordance with a determination that the totalnumber of viewers is within a predefined range of a plurality ofpredefined mutually non-overlapping ranges, the connected TV is,automatically and without human intervention, placed or maintained intoa respective operating mode of the plurality of operating mode accordingto the potential relationship.
 4. The method of claim 1, wherein arespective operating mode of the plurality of operating modes isassociated with different control settings.
 5. The method of claim 1,wherein in accordance with the potential relationship allowing theviewers to share private information, the viewers are family members,belong to a social circle, or have shared all private information ormedia content.
 6. The method of claim 3, wherein the plurality ofpredefined mutually non-overlapping ranges includes: a predefined rangefor a small group of viewers, and a predefined range for a large groupof viewers, and wherein the plurality of operating modes includes: apersonal mode, a shared mode, and a party mode.
 7. The method of claim6, wherein in the personal mode, voice or motion control of theconnected TV is enabled; and wherein in the party mode, voice or motioncontrol of the connected TV is not enabled.
 8. The method of claim 6,wherein in the personal mode, personal information received from anexternal source can be displayed on the connected TV, wherein in theshared mode, personal information received from an external source maynot be displayed; and wherein in the party mode, personal informationreceived from an external source may not be displayed on the connectedTV, and media content appropriate for a large group of viewers isdisplayed on the connected TV.
 9. The method of claim 8, furthercomprising: placing or maintaining the connected TV in or into thepersonal mode when a total number of viewers is 1; placing ormaintaining the connected TV in or into the personal mode or the sharedmode based on the potential relationship when the total number ofviewers is 2 to 3; or placing or maintaining the connected TV in or intothe personal mode or the party mode based on the potential relationshipwhen the total number of viewers is 4 or more.
 10. The method of claim8, wherein the media content appropriate for a large group of viewers isone of: a photo slideshow, an audio and video streaming, or a partygame, and wherein the personal information associated with a viewer isone of: incoming or outgoing phone calls, text messages, instantmessages, emails, or histories thereof.
 11. The method of claim 8,wherein the media content appropriate for a large group of viewersincludes media content associated with a group of viewers.
 12. Themethod of claim 8, wherein the media content appropriate for a largegroup of viewers includes public media content associated with anindividual viewer.
 13. A computer system, comprising: one or moreprocessors; memory; and one or more programs, wherein the one or moreprograms are stored in the memory and configured to be executed by theone or more processors, the one or more programs including instructionsfor: determining identities of viewers of a connected TV, the connectedTV having a plurality of operating modes; identifying a potentialrelationship among the viewers based on the identities of the viewers;in accordance with a determination that the potential relationshipallows the viewers to share private information: automatically, withouthuman intervention, placing or maintaining the connected TV in or into afirst operating mode unrelated to media content being displayed on theconnected TV, wherein while in the first operating mode personalinformation can be displayed on the connected TV; and in accordance witha determination that the potential relationship does not allow theviewers to share private information: automatically, without humanintervention, placing or maintaining the connected TV in or into asecond operating mode unrelated to the media content; wherein the secondoperating mode is different from the first operating mode, wherein whilein the second operating mode personal information may not be displayedon the connected TV.
 14. The computer system of claim 13, wherein arespective operating mode of the plurality of operating modes isassociated with different privacy settings.
 15. The computer system ofclaim 13, wherein the one or more programs further comprise instructionsfor obtaining a total number of viewers of the connected TV by one of:(i) collecting facial or voice recognition data associated with theviewers; and determining the total number of viewers of the connected TVbased on the facial or voice recognition data; (ii) collectinginformation identifying one or more consumer electronic devicesassociated with the viewers; and determining the total number of viewersof the connected TV based on the information identifying the consumerelectronic devices; or (iii) collecting a user input indicating thetotal number of viewers of the connected TV.
 16. The computer system ofclaim 13, wherein the one or more programs further comprise instructionsfor: identifying a particular individual, among a plurality ofindividuals, based on information identifying the viewers; andtransferring or maintaining control of the connected TV in accordancewith an identification of the particular individual.
 17. Anon-transitory computer readable storage medium storing one or moreprograms, the one or more programs comprising instructions, which whenexecuted by a computer system with one or more processors, cause thecomputer system to: determining identities of viewers of a connected TV,the connected TV having a plurality of operating modes; identifying apotential relationship among the viewers based on the identities of theviewers; in accordance with a determination that the potentialrelationship allows the viewers to share private information:automatically, without human intervention, placing or maintaining theconnected TV in or into a first operating mode unrelated to mediacontent being displayed on the connected TV, wherein while in the firstoperating mode personal information can be displayed on the connectedTV; and in accordance with a determination that the potentialrelationship does not allow the viewers to share private information:automatically, without human intervention, placing or maintaining theconnected TV in or into a second operating mode unrelated to the mediacontent; wherein the second operating mode is different from the firstoperating mode, wherein while in the second operating mode personalinformation may not be displayed on the connected TV.
 18. Thenon-transitory computer readable storage medium of claim 17, wherein theone or more programs further comprise instructions for: identifying aparticular individual based on information identifying the viewers; andsending a reminder to the particular individual of an event associatedwith the one or more viewers.
 19. The non-transitory computer readablestorage medium of claim 17, wherein: the connected TV is paired with adevice external to the connected TV; while in the first operating modepersonal information received from the external device can be displayedon the connected TV; and while in the second operating mode personalinformation received from the personal device may not be displayed onthe connected TV.
 20. The non-transitory computer readable storagemedium of claim 17, wherein the one or more programs further compriseinstructions for: determining a change in a total number of viewers ofthe connected TV; and in accordance with the changed total number ofviewers of the connected TV, placing or maintaining the connected TV inor into one of the plurality of operating modes.